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By means of the theory of abstract harmonic analysis methods 
are constructed for rapidly computing correlation functions. The 
theory being developed includes as a particular case the familiar 
Fourier transform method for a correlation function which makes 
it possible to find images which are independent of their trans- 
lation in the plane. In the paper we describe two examples of 
the application of the general theory: the search for images, 

independent of their rotation and scale, and the search for 
images which are independent of their translations and rotations 
in the plane. 


INTRODUCTION 


/3 


Denote by f(x) a positive bounded function in the plane, 
e.g., the image of a part of a printed text, and by v(x) the 
standard image of any letter from the text, say the letter "A". 
Let us calculate the correlation function 

-3 

K(x/ - d) 

(Here x is a vector with component s. x^ , • The coordinates of 

x which attain the absolute maximum K(.x), indicate the position 
of the letter "A" in the text: the letter "A" in the text f(x) 

is translated towards the vector x from the energy center of the 
standard v(x) [1]. 


*Numbers in the margin indicate pagination of original foreign text . 
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It is well-known that the holographic method of reading 
printed texts is based on this principle [1, 2] . By means of a 
monochromatic light source and a system of iienses the Fourier 
transform of the image is performed; in its turn the correlation 
function (1) can be expressed in terms of a Fourier transform: 

K(t)=mf(o. (2) 

(The stroke denotes the complex conjugate). 

Computation of the correlation function (.1) on digital 
computers with the help of Fourier analysis (2) has found 
especially widespread use after the invention of the RFT — the 
rapid Fourier transformation method [3]. If the standard and the 
image are given on the network N x N, then when the RFT methods 

are applied to calculate the correlation function, only arithmetic 

2 4 

operations on the order of N log2N are required, as against ~N 

operations if the integral (1) is computed directly. On a .network 

of ~ 500 x 500 elements the payoff in terms of high speed re- 

4 

sponse is approximately 10 fold. 

However, if the standard letter is turned around relative 
to the letters in the text, or if its size is different from /4 

that in the text, correlational analysis by means of formulas 
(1) and (2) becomes impossible. Computation of correlations 
by means of formula (1) makes it possible to detect only those 
images which are invariant with respect to translations, but not 
with respect to rotations or scale transformations. 

1 . Cbrrelational analysis for arbitrary groups . 

In the present paper it is emphasized that it is possible 
to construct a correlation function, expand it in a Fourier 
series, and after certain natural approximations, to apply the 
RFT methods in the general case when an arbitrary group of trans- 
formations is assumed. As an example we shall consider groups 
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of scale and rotational transformations, and a group of motions 
of , the plane (translations and rotations). The application of 
abstract harmonic analysis, as in the example with the group of 
translations (1), makes it possible to achieve a substantial 
economy in computations. 

Let G be a group which maps x into x, and let g be the ele- 
ments of the group. The correlation function has the form: 

\K($) Vff'xJ H*)*-' (3) 

The basis of the correlational analysis is the Schwartz in- 
equality [1], For any element g of the group: 

f tT ( fxj f(*J d* * ( ( *0 


The search for the standard v(x) in the image f(x) reduces 
to the search for an element of the .group g for which one of the 
local maxima of the ratio ^ is attained, 

or what is the same thing, such tnat the maximum 

, (5) 


is attained, where T(g) is the Jacobian of the change to the 
variable x’ = gx. 


For the correlation function (1), due to the invariance of 
the measure dx "on the group of translations, 
does not depend on g. 


Spectral analysis of the correlation function (3) does not /5 
actually differ from the classical spectral analysis on convolu- 
tions [4] . Recall that during the spectral analysis of convolu- 
tions, the space X is decomposed into homogeneous spaces relative 
to the group G. Each homogeneous space is identified with the 
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factor group. G/H, where H is a stationary subgroup of some point 
x (hx = x for all,/? £// )', and the invariant measure on the factor 
group G/H is obtained from the left- Cor right-) invariant measure 
on the group G. (.It is assumed that the group is locally com- 
pact). The Fourier coefficients are found when expanding the 
functions v(.x) and f(.x) with respect to the matrix elements of 
the irreducible unitary representations of the group. 

In practice the classical approach is not always convenient . 

For example, if only the group of rotations is given, then the 
"radial" part of the measure in the correlation integral can not 
be determined from the measure on the group. For any continuous 
group it is convenient to start with the measure dx and to con- 
struct a relatively invariant measure on the group 15]. What 
has been said will be illustrated below in concrete examples. 

Computations on digital computers can be performed only 
on finite bases and networks] therefore, the initial group (as 
a rule, non-compact) is "compactified" . For example, in a case 
involving a non-compact group of translations we convert to a 
compact group of additions modulo 2T, where T is the interval of 
definition of the functions v(x) and f(x). Next the compact 
group obtained is replaced by a discrete group. In the example 
under consideration, involving a group of two-dimensional trans- 
lations, the direct sum of two groups of whole numbers multiplied 
modulo N^ and Ng, where N-^ 'and are the number of nodes of the 

decomposition with respect to the axes and X respectively, /_§_ 

appears as a discrete group. After discretization the calcula- 
tions can be performed on a digital computer. Analogous trans- 
formations are necessary in the case of other continuous or 
non-compact groups. The possibility of using RFT with arbitrary 

groups arises following the discretization procedure. 

/ 

2 . High speed methods for calculating the Mellin and 
Fourier-Bessel transforms. 
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We shall denote the initial functions and their images by 
the same letter, but the argument symbols will vary. 


1. The continuous Fourier transform in Cartesian coordinates; 






( 6 ) 


where (x,y) is the scalar product. 


2. The continuous Fourier transform in polar coordinates: 

< cpi.vj( r- r, 

fff. fj. 


ff^J- 


3. The discrete Fourier transform: 


4. The inverse discrete Fourier transform; 


fW -- ¥‘ f(*J - ,7 Z W e 
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5. The Mellin transform: 


(.7) 


(. 8 ) 


(.9) 


f (fJ = Jf '* 1 


(19) 


6. The Fourier-Bessel transform: 


n 


f ( R ) = 3 *” f fp = h fyxjf (11) 
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The complex conjugate transforms are obtained by changing 
the sign of the argument : 


/ 7 *;= > 

f( n) -- ffrj <P.*s fW ‘ 

/( rt j ^C P ' > ■ 


In the correlation analysis of the group M(2) use is made 
of the fact that 



2fe'*<P.„A 


/7 

/7 f ? 

' ' 



(1-3) 


In the proof of (13) the following integral representation of 
Bessel functions is used [61: 


-y / . . 1 ^ /■ < X fcD ft S ~ £ /7 

4 iV ’ ~ Je 


< X S / S7 O 


ja y 

c 


n/6 *■ 7 

S/z & 


(.14) 


The 'Me 11 in and Fourier-Bessel transforms reduce to a con- 
tinuous Fourier transform: 


' /e ' r */(e e Jeft - /fey. 


(15) 


The Fourier-Bessel transform (.11) has the form of a corre- 
lation function on the group of scale transformations ; therefore 
the harmonic expansion of this transform can be carried out with 
the help of the Mellin transform: 
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fl , 

</**•* 3 «f = /* 'c/fi fz (Xf ) J> f/fj - 


-/*+/ 


--Iw pPjxm * dx -/> pp/)][m k , a x j], 

r\ s\ v 


(16) 


It is well known [7] that the Mellin transform of Bessel 
functions is expressed in terms of gamma functions: 


/8 




r(*A)A('>- s r"J, 


( Cl^O , /> > Q - J ) . For the 


case n = a: 


yd, x y (*) dx* 2 rf —)A{-r * y > 


Due to the connection between the Mellin and Fourier trans- 
forms (15), all the transforms ( 1 6 ) can be performed rapidly, 
and therefore the same is true of the Fourier-Bessel transform. 

The functions (17) can also be computed rapidly; therefore 
it is not necessary to tabulate them in advance. To compute 
the functions (17) rapidly, the Bessel functions are represented 
with the aid of the Fourier transform (14). 

3 . Scale-rotational transformations . 

Let us carry out the harmonic expansion of the correlation 
function used in the recognition of images independent of scale 
transformations and rotation. The correlation function expressed 
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in polar coordinates has the form: 


*=>«=» jJT 

* j - y ^ ^ us) 

. .. _ . o J - - ■ ■ ■ - ' ' ' 

Parameters of the group g: R is the scale factor; ¥ is the angle 
of rotation. 


The measurej is not invariant relative to the scale 

transformations; therefore, according to (5), during the corre- 
lational analysis it is necessary to find the maximum of the 
normalized correlation function: 


1 A H : /f d f J 7 y, r-rjftf' V ■ 


(.19) 


Since the group G is the direct sum of a multiplicative and /£ 
additive group, in order to perform a harmonic analysis it is 
necessary to apply the discrete Fourier transform in the case of 
the argument ¥, and the Mellin transform in the case of the 
argument R. On applying the discrete Fourier transform to parts 
of (19) we obtain: 

'■ *'(*.»)= <20) 
o 

After application of the Mellin transform to (20) we have: 

K ‘fi, *7 y ■ (21) 

The representation (21) shows that the harmonic _exp an si on makes 
it possible when calculating the function ^ J to get by 

with the order N^log 2 N of the operations (if the region of varia- 
tion of ¥ is broken up into N nodes and the region of variation 
of p is broken up into N nodes), as againstpr^/^ operations, if 
(19) is computed directly. 



It is especially important to note that harmonic analysis 
makes it possible to perform all calculations without inter- 
polation, i.e., using the values of the functions and 


only in the case of the given set of nodes'. In parti- 
cular in the example under consideration the domain of variation 
(0, ZJT ) is decomposed into N equivalent nodes, and the 
domain [ P (~T, T) , into the nodes 0 . -/ 

■ - - Ji ~ ' 




(A7 = 



■J*' e 


- 1 +&T 
* 


). 


The group of plane motions M(.2) . 


Next let us make a correlational analysis for the recogni- 
tion of images which are independent of translations and rota- 
tions. .The correlation function has the form: 

K(ct,*J = / f( x J ** • 

where a is the translation vector, a is the angle of rotation, /10 
x a denotes the rotation of the vector x through the angle a. In 
[6] an irreducible representation of the group M(2) is con- 
structed and the leading role of the Fourier-Bessel transform 
is shown. The harmonic analysis of the correlation function (.22) 
is carried out as follows. To begin with, we apply the con- 
tinuous Fourier transform: K(%°<J=% a K(ay) , which de- 

composes (22) into a product: 

KyJ- , ( 23 1 

Next, in (23) the argument y is written in polar coordinates 

(?,>") : 


K(\ ( 2 1 *) 
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The application of two discrete Fourier transforms 
yields: 


<P <P Xfot*) 

*4 


AY> ** t ») = V /(*, s?rsnj 


(25). 


Using the ratio (.13), we finally obtain the following harmonic 
decomposition : 


or 


Y "f ' K £ ^ Y i ** . 

k A /-/i ») -j? {*/ 'fa v / A A , 


where 


A. 

/(W -9%, 

/'A aY ^ ^ 


(26) 


All the transforms involved in (26) are carried out rapidly. /II 
The computation of the correlation function by means of harmonic 

"3 

analysis requires on the order of N logpN arithmetic operations 
( it _is_ ass umed that the domains of change of the variables 

| J? •, ^ are divided into N nodes each), as against r N'* 

operations if (22) is calculated directly. 


Conclusion 


Let us mention a number of problems whose solution would be 
facilitated by further progress in the applications of the methods 
of abstract harmonic analysis to the recognition of images. 
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1. In the performance of harmonic analysis with respect 

to RPT exclusively, among the most interesting groups in the 
practice of the development of images are: motion of the plane 

simultaneously with a scale transformation; projective trans- 
formations; groups acting in three-dimensional space, and Lie 
groups in the plane for the study of non-linear distortions, e.g 
in the problem of reading a handwritten text . 

2. Construction of general methods for finding RFT for 
arbitrary groups. In connection with this problem it is inter- 
esting to consider the possibility of approximating a compact 
and discrete initial group with the help of RFT functions which 
serve as a representation of finite Abelian groups [8]. Analysi 
of RFT for these groups has been partially carried out in [9]. 

3. Investigation of the behavior of a correction function 
near local maxima for different kinds of images. 

4. Construction of analogous systems which realize spec- 
tral analysis in groups similar to what was done in the case of 
the Walsh transform and the discrete Fourier transform. 
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